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A  Group  Factor  in  Immediate 

Memory 

CHAPTER  I. 

The  Problem* 

/.  Purpose  of  the  Present  Investigation 

The  present  study  is  an  experimental  attack  upon  a  specific 
problem  in  the  organization  of  mental  traits.  Recent  discus- 
sions regarding-  the  presence  of  a  number  of  independent 
"group  factors"  in  mental  organization  make  experimental 
identification  and  isolation  of  such  factors  timely  and  desir- 
able. It  is  with  one  of  these  proposed  "group  factors,"  namely 
memory,  that  the  present  investigation  is  concerned.  This 
study  undertakes  to  find  an  experimental  answer  to  the  ques- 
tion of  the  existence  of  a  common  factor  through  a  number  of 
memory  tests  and  its  relation  to  other  factors.  If  such  a 
memory  factory  is  discovered,  a  battery  of  tests  for  measuring 
it  will  then  be  constructed  and  the  efficiency  with  which  this 
battery  estimates  the  central  factor  determined. 

II.  Principles  Underlying  the  Choice  of  Tests 

One  of  two  principles  could  logically  be  followed  in  the  selec- 
tion of  memory  tests  to  be  used  in  such  a  study.  On  the  one 
hand,  we  could  select  a  random  sampling  of  as  many  different 
types  of  memory  tests  as  possible,  including  variations  in 
modality,  materials,  method,  and  duration  of  delay.  On  the 
other  hand,  we  could  restrict  the  scope  of  the  tests,  and  pro- 
ceed to  an  intensive  investigation  of  some  one  phase  of  mem- 
ory ability.  The  method  of  selection  finally  adopted  is  inter- 
mediate between  these  two  principles.  Obviously,  the  first 
method  only  could  lead  to  a  conclusive  answer  to  the  question 
of  a  general  memory  factor.  However,  if  there  should  be  no 
factor  as  general  as  this,  but  only  more  restricted  memory 
group  factors,  it  would  be  impossible  to  identify  such  smaller 


*  This  study  is  one  of  a  series  of  researches  (under  the  general  direc- 
tion of  Professor  H.  E.  Garrett)  supported  by  a  grant  from  the  Council 
for  Research  in  the  Social  Sciences,  Columbia  University. 
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factors  unless  a  sufficiently  large  number  of  tests  of  each  type 
had  been  used.  If  this  were  done,  however,  the  number  of 
necessary  tests  would  be  too  large  to  use  in  a  single  study  on  a 
single  group  of  subjects.  On  the  other  hand,  if  the  study  is 
restricted  too  narrowly,  then  whatever  group  factors  are 
found  will  be  too  restricted  to  be  of  much  significance.  It  was 
finally  decided  to  limit  the  study  to  immediate  memory  for 
visually  presented  material.  Within  this  field,  variations  of 
method  and  material  were  introduced.  If  the  existence  of  a 
group  factor  of  immediate  memory  is  established  in  the  pres- 
ent study,  it  will  then  be  feasible  to  combine  tests  of  immedi- 
ate and  delayed  memory  in  a  more  comprehensive  search  for 
a  group  factor  through  all  memory  tests. 

In  the  construction  of  the  memory  tests,  the  attempt  was 
made  to  eliminate  as  far  as  possible  the  presence  of  variables 
other  than  memory,  in  order  not  to  complicate  the  relation- 
ships found.  Any  procedure  involving  fine  discriminations 
or  very  close  or  sustained  attention  was  carefully  excluded. 
The  use  of  "logical"  material  was  also  considered  undesirable, 
since  its  recall  depends  on  too  many  variables  other  than  mem- 
ory, such  as  interest  in  and  understanding  of  the  passage  used, 
information,  past  experience,  etc. 

In  order  to  establish  the  independence  of  the  memory  factor, 
it  is  essential  to  include  in  the  study  a  number  of  non-memory 
tests.  For  this  purpose,  three  tests  were  selected  which  were 
as  nearly  as  possible  measures  of  three  other  group  factors, 
viz.,  verbal  and  numerical  ability  and  a  possible  spatial  ability. 
Although  the  presence  of  the  last-named  factor  has  not  yet 
been  established,  the  most  carefully  constructed  "spatial"  test 
available  was  used.  The  factors  of  verbal  and  numerical  abil- 
ity having  already  been  investigated,^  it  was  possible  in  these 
cases  to  use  tests  whose  efficiency  in  measuring  the  central 
factor  was  definitely  known. 

///.  Principles  Underlying  the  Choice  of  Subjects 

A  special  attempt  has  been  made  in  the  present  study  to  ob- 
tain a  high  degree  of  homogeneity  within  the  group  of  sub- 
jects used,  in  order  to  avoid  spurious  correlations  resulting 
from  extreme  variations  within  the  group.  Heterogeneity 
may  arise  from  differences  in  maturity,  sex,  racial  or  national 

'Cf.  Schneck  (34). 
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descent,  educational  or  social  status,  and  similar  influences  of 
heredity  or  environment ;  such  heterogeneity  may  either  raise 
or  lower  a  correlation  coefficient,  depending  upon  whether  the 
two  variables  correlated  vary  in  the  same  or  opposite  direc- 
tion, respectively,  as  the  third  variable.  A  group  heterogene- 
ous with  respect  to  maturity  usually  yields  correlations  higher 
than  the  true  value,  since  most  capacities  increase  with  age. 
The  two  variables  correlated,  in  this  case,  would  always  vary 
in  the  same  direction  with  the  third  variable,  age,  both  in- 
creasing as  age  increases.  It  is  also  possible,  however,  for 
heterogeneity  to  lower  a  correlation  coefficient.  Let  us  suppose 
that  a  sampling  is  made  up  of  two  groups,  of,  for  example, 
different  racial  extraction.  Now,  if  one  of  the  two  races  excels 
the  other  markedly  in  trait  A,  but  is  decidedly  inferior  to  it 
in  trait  B,  then  lumping  the  two  groups  would  tend  to  produce 
a  negative  correlation  between  traits  A  and  B,  and  would 
therefore  yield  a  value  lower  than  the  relationship  existing 
within  either  of  the  two  groups. 

Having  shown  that  heterogeneity  does  affect  a  correlation 
coefficient,  it  may  be  well  to  discuss  just  how  far  homogeneity 
in  a  sampling  yields  results  which  are  the  best  approximation 
to  the  "true"  relationships  sought.  If  it  were  possible  to  ob- 
tain a  group  of  subjects  perfectly  identical  with  respect  to 
all  influences  of  heredity  and  environment,  there  would  be  zero 
variability  in  all  traits  within  the  group  and  no  correlation  be- 
tween any  of  the  variables  could  be  obtained.  Obviously,  we 
should  not  want  to  eliminate  all  heterogeneity,  even  if  such  a 
thing  were  possible.  What  we  actually  want  to  find  in  any 
study  of  trait  organization  are  the  relationships  existing 
within  the  total  population  about  which  we  draw  conclusions, 
in  most  studies  this  population  being  the  total  human  race. 
Now,  if  we  select  extreme  groups  and  lump  them  together  in 
treating  the  data,  obviously  the  relationships  found  will  not 
be  those  which  we  would  find  if  we  tested  the  entire  human 
race.  Since  most  abilities  have  been  found  to  be  distributed 
according  to  the  normal  Gaussian  curve,  extreme  cases  will  be 
very  few  in  the  total  population.  Furthermore,  the  effect  of  a 
few  extreme  deviations  on  a  correlation  coefficient  will  be  less, 
the  larger  the  number  of  cases.    It  is  obvious  that,  since  r  = 

^^^  ,  the  effect  of  any  one  product-deviation  on  r  increases 
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inversely  as  the  size  of  N.^  Therefore,  if  we  wish  to  obtain 
the  relationships  existing  in  the  total  population,  we  must 
have  fewer  extreme  deviations,  i.e.,  our  group  must  be  more 
homogeneous,  the  smaller  the  N.  It  is,  of  course,  impossible 
to  determine  the  exact  degree  of  homogeneity  required  in  the 
sampling  to  make  the  results  representative.  The  safer  policy 
therefore  seems  to  be  to  err  in  the  direction  of  excess  rather 
than  insufficient  homogeneity,  obtaining  as  a  result  correla- 
tions lower,  rather  than  higher  than  the  "true"  relation.  This 
may  obscure  a  "true"  relationship  which  is  very  small ;  how- 
ever, the  discovery  of  such  a  relationship,  so  small  in  the  first 
place,  would  hardly  be  very  valuable.  This  result  certainly 
seems  less  seriously  misleading  than  the  spurious  appearance 
of  correlation  where  there  is  no  "true"  relationship. 

The  maturity  factor  was  controlled  in  the  present  study  by 
the  use  of  adult  subjects,  all  of  whom  were  either  past  or  very 
close  to  their  growth  limit  in  mental  capacities.  This  was 
considered  preferable  to  the  use  of  children  of  the  same  chron- 
ological age.  Until  more  definite  information  is  available  on 
growth  curves,  we  cannot  justifiably  assume  that  all  children 
of  the  same  chronological  age  have  attained  the  same  propor- 
tion of  their  ultimate  adult  capacity.  Hence,  we  cannot  be 
certain  that  we  have  controlled  the  maturity  factor  by  hold- 
ing chronological  age  constant,  unless  all  our  subjects  have 
reached  or  passed  their  mental  growth  limit. 


*  An  illustration  will  make  this  clearer :   Using  reduced  scores,  all  a's 
2Z.Z2 


equal  to  1,  then  r 


N 


Let     SziZj  =  k  +  3,  in  which  3  is  one  of  the  product-deviations 

Let  Sz'iz'j  =  k  +   7,  in  which  7  is  one  of  the  product-deviations 

If  N  =  10,  If  N  =  100, 

-  -    ^^'^'    =A  +  .3z=C-f.3         r=  ^^^  =  -A  +  .03  =  C  +  .03 


10  10  100         100 

10  10  ^  ^  100  100  ^  ^ 

.  • .  the  difference  in  r  is  .4  .  • .  the  difference  in  r  is  .04 


CHAPTER  II. 

The  Literature 

A  survey  of  the  experimental  literature  on  memory  in 
search  of  data  bearing  on  the  interrelationships  of  memory 
tests  yields  a  number  of  miscellaneous  correlation  coefficients, 
frequently  computed  only  incidentally  to  the  solution  of  some 
other  problem.  In  most  studies,  only  a  few  of  all  the  possible 
intercorrelations  of  the  variables  used  have  been  computed; 
systematic  correlation  studies  on  memory  are  very  rare;  only 
two  or  three  go  beyond  correlation  and  apply  some  more  con- 
clusive criterion  in  the  attempt  to  arrive  at  a  general  memory 
factor.  These  latter  studies  will  be  discussed  in  greater  detail 
further  in  the  present  chapter.  In  addition,  an  attempt  has 
been  made  to  present  a  systematic  analysis  of  correlations 
which  have  been  reported  in  the  literature  on  memory.  These 
include  correlations  among  different  tests  of  memory,  as  well 
as  a  few  correlations  between  memory  tests  and  tests  or  esti- 
mates of  other  capacities.  The  data  have  been  analyzed  and 
tabulated  on  the  basis  of  the  criteria  considered  most  signifi- 
cant in  the  present  approach  to  the  problem.  These  criteria 
include :  number  and  description  of  subjects,  in  an  attempt  to 
get  at  the  statistical  reliability  of  the  results  with  regard  to 
size  of  N  and  homogeneity  of  the  sampling ;  a  brief  description 
of  the  tests  used,  with  special  reference  to  materials,  modality, 
number  of  repetitions,  duration  of  delay,  and  method  of  test- 
ing retention;  finally,  the  reliability  coefficients  of  the  tests 
used  whenever  reported,  and  the  intercorrelations  computed 
are  given.  It  is  hoped  that  whatever  value  the  present  or 
similar  investigations  may  derive  from  these  past  studies  on 
memory,  will  be  brought  out  more  fully  by  this  analysis  of 
the  data.  This  analysis  is  presented  in  Table  I.  The  studies 
reported  have  been  arranged  in  chronological  order. 

A  few  of  the  studies  reported  in  Table  I  have  been  selected 
for  more  detailed  discussion,  as  bearing  more  directly  on  the 
present  problem  in  their  general  method  of  approach.  Carey 
(Table  I — No.  11)  after  obtaining  the  correlations  of  his 
pooled  tests  of  visual,  auditory,  and  verbal  memory,  with  each 
other,  computed  the  correlation  of  each  pool  with  what  was 
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common  to  all  three,  by  Spearman's  formula  for  rag.^  These 
correlations  were  found  to  be : 

r  =  .37  for  verbal  memory  and  g 
r  =  .52  for  auditory  memory  and  g 
r  =■  .47  for  visual  memory  and  g 

He  then  computed  the  "specific  correlations"  between  the 
pools,  i.e.,  the  correlations  with  g  partialed  out.  These  corre- 
lations are : 

r  between  auditory  and  visual  memory  =  .27  d=  .048 
r  between  auditory  and  verbal  memory  =  .19  ±:  .052 
r  between  visual  and  verbal  memory      =  .13  rt  .052 

Since  these  residual  correlations  are  significantly  greater 
than  zero,  Carey  concludes  that  they  indicate  the  presence  of  a 
"small  general  memory  factor,"  in  addition  to  Spearman's  g. 
Garrett  (Table  I — No.  29)  reports  all  the  tetrad  differences 
with  the  correlations  obtained  from  his  five  memory  and 
three  learning  tests.  The  median  deviation  from  zero  of  the 
obtained  distribution  of  tetrad  differences  was  then  evaluated 
in  terms  of  the  P.E.  of  the  entire  distribution.  Although  the 
obtained  median  tetrad  difference  was  slightly  larger  than  the 
theoretical  P.E.,  on  analysis  this  was  found  to  be  due  to  the 
close  similarity  of  some  of  the  tests,  introducing  group  fac- 
tors. It  was  therefore  concluded  that  there  was  a  general  fac- 
tor through  all  the  tests.  Partialing  out  Thorndike  Scores 
(taken  as  an  approximate  measure  of  Spearman's  g)  reduced 
the  average  intercorrelation  to  .11,  still  significantly  above 
zero.  It  was  suggested  on  this  basis  that  there  is  a  small 
memory  factor  apart  from  g.  Kelley  (Table  I — No.  30)  re- 
ports the  tetrad  differences  computed  from  the  correlations  of 
his  tests  of  memory,  reading,  arithmetic,  and  space  relations. 
An  analysis  of  group  factors,  indicated  by  the  tetrads,  is 
given  on  the  basis  of  a  criterion  stated  in  proposition  No.  16 
(Kelley,  26  pg.  69  ff.).  Estimates  of  the  weights  with  which 
each  of  a  number  of  factors,  including  memory  ("delta  fac- 
tor"), entered  into  performance  in  each  test  were  then  ob- 
tained by  a  series  of  approximations.  These  factor  values 
are  given  for  each  of  the  populations  used.     Kelley  finds  a 


=  V^ 


J  Tab    Tac 
rag  r-     '_ 

rbc 
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large  "alpha"  factor  running  through  all  his  tests,  which  he 
credits  to  the  heterogeneity  of  his  group  with  respect  to  ma- 
turity, sex,  race,  etc.  The  present  study  is  a  more  detailed 
experimental  attack  on  Kelley's  "delta"  factor,  memory.  The 
"alpha"  factor  is  experimentally  controlled  by  the  use  of  a 
homogeneous  group. 

Critique  of  Previous  Studies 

An  examination  of  Table  I,  and  the  accompanying  discus- 
sion suggests  a  number  of  inadequacies  or  defects  in  previous 
studies  which  make  any  conclusive  evaluation  of  the  results 
extremely  dubious.  Perhaps  the  most  fruitful  and  suggestive 
conclusion  that  can  be  drawn  from  such  a  survey  of  the  lit- 
erature is  an  enumeration  of  just  those  defects  in  meth- 
odology and  technique  which  make  any  conclusions  regarding 
the  presence  of  a  memory  factor  impossible.  One  or  more  of 
the  following  criticisms  could  be  offered  against  any  of  the 
studies  reported. 

1.  The  use  of  small  samplings:  The  size  of  N  affects  P.E.r 
and  P.E.t  very  markedly.  If  a  P.E.  is  extremely  large, 
it  merely  shows  that  our  determination  of  the  correla- 
tion coefficient,  or  tetrad  difference,  as  the  case  may  be, 
may  differ  very  widely  from  the  true  value ;  but  it  hardly 
justifies  a  conclusive  evaluation  of  the  obtained  value  in 
terms  of  such  a  P.E. 

2.  The  use  of  samplings  heterogeneous  with  respect  to  age, 
sex,  racial  or  national  background,  educational  and  so- 
cial status,  etc.  Column  III  of  Table  I  gives  adequate 
evidence  that  this  criticism  applies  to  a  large  number  of 
studies.  The  effect  of  heterogeneity  on  the  correlations 
obtained  has  been  discussed  in  Chapter  I. 

3.  No  reliability  coefficients  are  reported  in  a  number  of 
studies.  Since  many  of  the  memory  tests  used  are  very 
short,  the  reliabilities  are  probably  quite  low,  thus  lower- 
ing the  intercorrelations  obtained.  In  several  cases,  the 
reliability  coefficients  are  reported,  but  are  fairly  low, 
and  hence  the  resulting  corrections  for  attenuation  very 
large.  In  such  cases  it  seems  rather  dangerous  to  work 
with  results  which  might  have  been  obtained  had  the 
reliabilities  of  the  tests  been  perfect,  and  which  never- 
theless have  been  estimated  from  results  obtained  with 
highly  unreliable  tests.  The  only  safe  procedure  in  such 
cases  seems  to  be  the  construction  of  new  tests  which  are 
more  reliable  in  the  first  place. 
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4.  The  large  majority  of  studies  which  report  only  corre- 
lation coefficients  can  at  best  be  only  suggestive,  not  con- 
clusive. Some  further  criterion  is  necessary  in  establish- 
ing the  presence  or  absence  of  group  factors. 

5.  Studies  using  only  tests  of  memory  can  at  best  only 
show  the  presence  of  a  central  memory  factor,  but  can- 
not show  its  independence  from  other  variables,  or  from 
"general  capacity."  Non-memory  tests  must  be  included 
to  test  the  independence  of  a  possible  memory  factor. 

6.  The  tests  used  are  frequently  complex  with  respect  to 
the  capacities  involved.  This  situation  obviously  com- 
plicates the  relationships  and  makes  evaluation  of  results 
more  difficult  and  indirect.  The  tests  should  be  as  far 
as  possible  measures  of  sheer  retentivity. 

7.  The  selection  of  tests  and  treatment  of  results  in  sev- 
eral studies  is  such  that,  although  the  presence  or  ab- 
sence of  a  general  factor  through  all  the  tests  may  be 
established,  no  light  can  be  thrown  on  the  presence  of 
narrower  group  factors.  The  latter  would  be  especially 
useful  when  negative  results  are  obtained  regarding  the 
presence  of  the  more  inclusive  factor.  This  point  has 
been  discussed  more  fully  in  Chapter  I. 

8.  The  use  of  the  formula  for  obtaining  the  P.E.  of  an 
entire  distribution  of  tetrad  differences  has  been  criti- 
cized by  Kelley  (26),  on  the  grounds  that  it  assumes  a 
normal  distribution  of  the  tetrad  differences.  The  actual 
form  of  the  distribution,  as  Kelley  points  out,  is  prob- 
ably not  normal,  due  to  the  correlation  of  the  chance  er- 
rors in  the  correlation  coefficients,  causing  the  chance 
errors  in  the  tetrads  also  to  be  correlated.  This  shorter 
technique  has  nevertheless  been  used  in  most  studies  as 
the  final  criterion  in  evaluating  the  obtained  tetrad  dif- 
ferences. 

9.  Spearman's  formula  for  the  correlation  of  a  test  with 
what  is  common  to  it  and  a  number  of  other  tests  (rag) 
has  been  used  in  detecting  group  factors.  This  is  hardly 
justifiable,  since  the  formula  assumes  the  absence  of 
any  such  group  factors  in  its  derivation. 


CHAPTER  III 

Procedure 
/.  Subjects 

The  group  of  subjects  finally  used  consisted  of  225  students 
at  the  College  of  the  City  of  New  York.  The  total  number  of 
subjects  taking  the  tests  was  315.  The  records  of  ninety  sub- 
jects were  discarded  either  because  of  incomplete  record  due 
to  absence  or  because  they  did  not  fulfill  the  qualifications 
required  to  maintain  the  desired  homogeneity  in  the  group. 
In  order  to  obtain  concrete  evidence  on  the  homogeneity  of 
the  group,  the  following  questionnaire  was  filled  out  by  each 
subject. 

Data  Sheet — A 

Name Class 

Age :  Years Months Place  of  Birth 

Mother's  Birthplace Father's  Birthplace 

Is  any  language  other  than  English  spoken  at  home? 

Father's  Occupation 

Father's  Education :  Elementary  School 

High  School College 

Are  you  Hebrew? 

Do  you  have  any  part-time  employment  while  at  college? 

If  so,  how  many  hours  a  week  does  it  occupy? 


The  results  of  this  questionnaire  have  been  tabulated  and 
are  presented  in  Table  II.  It  will  be  seen  that  the  records  of  a 
few  students  who  fall  outside  of  the  general  group  with  re- 
spect to  some  one  category  were  not  discarded.  These  results 
have  all  been  evaluated  in  terms  of  the  mean  and  standard 
deviation  of  the  group.  The  records  of  these  subjects  were 
kept  only  when  the  subject's  score  in  each  test  fell  within  one 
standard  deviation  from  the  mean  of  the  group.    The  inclu- 
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sion  of  these  scores  would  obviously  not  disturb  the  desired 
homogeneity.- 

//.  The  Tests 

The  following  eight  memory  tests  were  used.     All  were 
tests  of  immediate  memory  for  visually  presented  material. 

1.  Paired  Associates:  word — word. 

All  the  words  were  simple  four-letter  English  words. 

2.  Paired  Associates:  picture — number. 

Pictures  of  common  objects,  approximately  3x3  inches, 
in  black  and  white  were  paired  with  two-place  numbers. 
The  pictures  were  cut  from  newspapers  and  magazines. 
In  constructing  the  two-place  numbers,  all  digits  except 
zero  were  used.  Especially  familiar  combinations,  such 
as  25  and  75  were  omitted. 

3.  Paired  Associates :  form — number. 

Geometrical  forms,  approximately  3x3  inches  were 
drawn  in  India  ink  on  white  cards,  and  paired  with  two- 
place  numbers  as  in  test  2.  In  constructing  the  geomet- 
rical forms,  care  was  taken  to  make  the  forms  sufficiently 
different  from  each  other  in  order  not  to  necessitate  fine 
discriminations. 

4.  Paired  Associates:  color — word. 

Triangles,  circles,  squares,  and  lozenges,  in  red,  green, 
blue,  yellow,  orange,  and  purple  or  combinations  of  any 
two  of  these  colors  were  paired  with  four-letter  English 
words.  The  colored  forms  were  cut  out  of  Dennison's 
gummed  papers,  dull  finish  (numbers  122,  124,  125, 
126A,  120,  and  140) . 

5.  Digit  span:  four  parallel  forms  of  this  test  were  used, 
each  ranging  from  four  to  thirteen  digits. 

6.  Retained  members:  four-letter  English  words. 

7.  Recognition  of  geometrical  forms,  similar  to  the  forms 
used  in  test  No.  3. 

8.  Recognition  of  three-letter  nonsense  syllables: 

The  nonsense  syllables  were  taken  from  a  list  published 
by  Glaze  (18).  The  particular  syllables  used  were  se- 
lected from  a  list  of  101  syllables  found  by  Glaze  to  have 
zero  associative  value  for  his  group  of  subjects. 

All  the  test  materials  were  glued  on  rectangular  white  card- 


'  An  additional  advantage  of  using  this  group  of  subjects  lies  in  the 
fact  that  the  group  is  similar  to  the  group  used  by  Schneck  (34)  in  his 
study  of  V  and  N.  The  results  of  the  two  studies  are  therefore  directly 
comparable. 
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board  cards.  Black  two-inch  letters'^  and  numbers  were  used 
throughout.  Each  of  the  recall  tests  contained  a  total  of  forty 
items,  divided  into  shorter  sub-tests,  as  described  further 
(pg.  30).  Each  of  the  two  recognition  tests  contained  forty 
"old"  and  forty  "new"  items. 

In  addition  to  the  eight  memory  tests  described  above,  the 
following  three  tests  of  other  traits  were  used,  making  a  total 
of  eleven  tests. 

1.  Multiple  Choice  Vocabulary  Test: 

The  test  used  was  the  vocabulary  test  used  by  Schneck 
(34)  and  found  by  him  to  correlate  .90  with  the  central 
"verbal"  factor. 

2.  Arithmetic  Reasoning  Test: 

This  was  also  one  of  the  tests  used  by  Schneck  and  found 
to  correlate  .75  with  the  central  "number"  factor. 

3.  Minnesota  Paper  Form  Board  Test,  forms  A  and  B. 
This  test  is  described  by  Anderson  (3),  and  was  used  in 
the  attempt  to  get  at  a  measure  of  a  possible  "spatial 
ability."-* 

///.  Preliminary  Experimentation 

The  purpose  of  the  preliminary  investigation  was  manifold. 
It  was  desired  (1)  to  settle  details  of  procedure  and  to  decide 
upon  the  best  technique  of  administering  the  tests;  (2)  to 
eliminate  undesirable  items;  (3)  to  arrange  items  in  a  rough 
order  of  difficulty;  (4)  to  find  the  optimum  length  of  presen- 
tation series  for  each  test  which  would  give  no  zero  or  perfect 
scores  and  as  nearly  as  possible  a  normal  distribution.  The 
subjects  used  in  the  preliminary  experimentation  were  about 
180  Barnard  College  and  Columbia  University  Extension  stu- 
dents in  beginning  and  educational  psychology. 

The  following  arrangements  were  tried  for  each  recall  test 
and  the  resulting  distribution  of  scores  for  each  tabulated. 

1.  Single  series  containing  all  40  items. 

2.  Two  series  of  20  items  each. 

3.  Four  series  of  10  items  each. 

4.  In  a  few  cases,  two  presentations  of  series  of  20  items 
were  tried. 


'Wilson's  gummed  letters  and  numbers,  No.  P33,  supplied  by  Tablet 
and  Ticket  Co.,  115  East  23rd  Street,  New  York  City. 

*  The  Thurstone  Spatial  Relations  Tests  A  and  B  were  also  used,  but 
the  results  dropped  because  of  difficulty  in  understanding  directions  and 
low  reliability  coefficients. 
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With  the  two  recognition  tests,  the  only  arrangements  tried 
were: 

1.  One  series  of  80  items  (40  old  and  40  new) . 

2.  Two  series  of  40  items  (20  old  and  20  new). 

The  lengths  of  series  finally  chosen  for  each  test  are: 

1.  Word — word:  two  series  of  20  items. 

2.  Picture — number:  two  series  of  20  items. 

3.  Form — number:  four  series  of  10  items. 

4.  Color — word :  four  series  of  10  items. 

5.  Digit  span:  four  parallel  series,  each  ranging  from  4  to 
13  digits. 

6.  Retained  members:  one  series  of  40  items. 

7.  Form — recognition:  one  series  of  80  items. 

8.  Syllable — recognition:  two  series  of  40  items. 

Each  card  was  numbered  on  the  reverse  side  for  presenta- 
tion order  and  test  order. 

IV.  Testing  Procedure 

All  tests  were  given  by  the  group  method.  The  memory 
tests  and  the  Minnesota  Paper  Form  Board  Test  were  given 
in  seventeen  laboratory  sections  each  of  fifteen  to  twenty 
students.  All  this  testing  was  done  by  two  examiners,^  the 
regular  instructors  in  their  respective  laboratory  sections. 
The  tests  were  taken  by  the  students  as  part  of  the  regular 
laboratory  work  of  the  course.  Every  precaution  was  taken 
to  prevent  cheating.^  The  vocabulary  and  arithmetic  reason- 
ing tests  were  given  in  two  large  lecture  sections,  each  consist- 
ing of  about  150  students.'^  Table  III  gives  hour  of  day,  num- 
ber of  cases,  and  mean  score  in  each  of  the  memory  tests  for 
each  of  the  sixteen^  laboratory  sections  included  in  the  final 
results.  These  data  were  collected  as  a  check  on  the  uniform- 
ity of  conditions  under  which  the  tests  were  given.  The 
means  and  standard  deviations  of  the  entire  group  in  each  test 
are  also  given.    It  will  be  seen  that  the  means  of  each  section 


*  Prof.  H.  D.  Marsh  and  Mr.  John  G.  Peatman. 

*  Only  two  records  had  to  be  discarded  on  this  account. 
'  These  tests  were  given  by  Dr.  M.  R.  Schneck. 

*  One  of  the  sections  was  dropped,  since,  through  lack  of  time,  some 
of  the  memory  tests  were  not  given  in  it. 
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are  in  all  cases  within  1  S.D.  of  the  mean  of  the  entire  group. 
The  statistical  evidence  for  the  uniformity  of  results  is  there- 
fore satisfactory. 

The  tests  occupied  a  total  of  approximately  six  hours,  in- 
cluding four  one-hour  laboratory  sections  and  two  lecture 
hours.  The  testing  was  extended  over  a  period  of  four 
months,  from  February,  1930,  to  May,  1930.  The  following 
testing  schedule  was  followed  in  all  the  sections. 

Testing  Schedule 

Period         Tests,  in  the  Order  Given 

I  1.  word — word 

2.  picture — number 

II  1.  form — number 

2.  form — recognition 

3.  syllable — recognition 

III  1.  color — word 

2.  digit  span 

3.  retained  members 

IV  Vocabulary 

V  Arithmetic 

VI  Minnesota,  form  A,  followed  immedi- 

ately by  form  B. 

The  following  points  were  considered  in  deciding  upon  this 
sequence : 

1.  Facilitation  in  comprehension  of  directions. 

2.  Beginning  with  easier  tests  and  tests  in  which  directions 
are  easier  to  understand. 

3.  Avoiding,  as  far  as  possible,  the  occurrence  during  the 
same  period  of  tests  using  similar  material,  in  order  to 
avoid  interference  effects. 

The  specific  directions  to  be  followed  in  administering  each 
test  were  typewritten  and  a  copy  given  to  each  examiner.  The 
cards  were  kept  in  piles  on  the  examiner's  desk,  face  down- 
ward. The  exposure  time  was  three  seconds  for  each  card  in 
all  memory  tests  except  the  digit  span ;  in  the  latter,  one  sec- 
ond was  allowed  for  each  digit  in  the  series,  the  exposure 
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time  therefore  ranging  from  four  to  thirteen  seconds.  Ex- 
posure time  was  controlled  by  the  beats  of  a  metronome,  set 
at  60. 

The  subjects  were  provided  with  mimeographed  data  sheets 
for  recording  responses  in  each  of  the  memory  tests.  These 
sheets  were  used  to  facilitate  writing  and  scoring  of  responses 
as  well  as  to  keep  the  testing  conditions  more  uniform. 

In  giving  the  vocabulary  and  arithmetic  reasoning  tests  the 
procedure  used  by  Schneck  (34)  was  followed  throughout. 
The  Minnesota  Paper  Form  Board  tests  were  given  with  a 
time-limit  of  15  minutes  for  each  form.  The  directions  were 
slightly  modified  from  those  used  by  Anderson  (3)  in  order  to 
adapt  the  test  to  an  adult  group. 

V.  Scoring 

The  paired  associates  and  retained  members  tests  were 
scored  in  terms  of  the  total  number  of  items  correct.  The 
recognition  tests  were  scored  by  subtracting  twice  the  num- 
ber wrong  from  the  total  number  of  items.''  In  the  digit  span 
test,  the  subject's  span  in  each  of  the  four  parallel  forms  was 
taken  as  the  longest  series  of  digits  correctly  reproduced  in 
the  correct  order;  no  partial  credits  were  given,  as  all  these 
methods  were  considered  too  arbitrary  and  would  probably 
yield  results  no  more  reliable  than  the  crude  span.  Since  there 
were  only  four  forms  of  the  digit  span  test,  the  method  of  con- 
stant stimuli,  suggested  by  Guilford  and  Dallenbach  (19) 
could  not  be  applied.  The  total  score  on  the  digit  span  test 
was  taken  as  the  average  of  the  crude  span  from  each  of  the 
four  forms.  The  vocabulary,  arithmetic  reasoning,  and  Min- 
nesota Paper  Form  Board  Tests  were  scored  in  terms  of  the 
total  number  of  items  completely  correct.  In  the  Minnesota 
Test,  an  item  was  scored  as  correct  when  all  the  necessary 
lines  were  drawn  in  the  correct  direction,  with  a  deviation  of 
not  more  than  one-eighth  of  an  inch  from  the  correct  position. 
These  deviations  of  one-eighth  of  an  inch  were  allowed  in 
order  not  to  penalize  subjects  for  habitual  carelessness,  as 
this  would  have  been  an  irrelevant  factor  in  testing  for  spatial 
ability.  Deviations  in  position  due  to  carelessness  were  dis- 
tinguished by  being  more  general,  occurring  throughout  an 
individual's  paper;  these  deviations  rarely  exceeded  the  limit 


•  No  omissions  were  allowed  in  the  recognition  tests. 
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of  one-eighth  of  an  inch;  deviations  greater  than  this  were 
confined  to  isolated  figures  and  probably  indicated  actual  lack 
of  spatial  orientation  in  the  cases  in  which  they  occurred. 

In  order  to  compute  reliability  coeflficients,  two  scores  were 
obtained  for  each  test.  On  paired  associates,  recognition, 
vocabulary,  and  arithmetic  reasoning  tests,  odd  and  even 
items  were  used  in  obtaining  the  two  scores.  In  the  retained 
members  test,  the  subject  was  told  simply  to  write  the  words 
as  he  recalled  them,  in  any  order;  hence,  we  could  not  score 
odds  against  evens  as  they  appeared  on  the  test  blanks,  since 
this  would  give  a  spuriously  perfect  reliability.  The  method 
followed  in  this  case  was  to  refer  each  word  on  the  subject's 
list  back  to  the  original  presentation  list,  and  score  it  as  odd 
or  even  according  to  the  order  of  the  original  list.  In  the 
digit  span  test,  the  first  and  third  forms  were  combined 
against  the  second  and  fourth.  This  arrangement  was  fol- 
lowed in  order  to  neutralize  the  combined  effects  of  practice 
and  fatigue  on  the  scores.  The  actual  averages  obtained  on 
each  of  the  four  forms  further  justifies  this  arrangement. 

Digit  Span  Averages: 
Form  I  II  III  IV 

Average  span  8.999  9.555  9.290  9.186 

In  computing  the  reliability  of  the  Minnesota  Test,  the  sub- 
ject's scores  on  Form  A  and  Form  B  were  correlated. 


CHAPTER  IV 

The  Results 

I.  Evaluation  of  the  Tests 

In  Table  IV  are  reported  means,  standard  deviations,  skew- 
ness,  and  reliability  coefficients  of  each  of  the  distributions  of 
test  scores.  All  of  these  data  are  based  on  the  225  records 
kept  in  the  final  results.  The  measures  of  skewness  are  given 
in  order  to  give  some  idea  of  the  normality  of  the  distributions 
worked  with.  Since  the  Pearson  coefficient  of  correlation  as- 
sumes normality  of  distribution  in  its  derivation,  it  seems  that 
any  study  depending  as  much  on  correlation  results  as  the 
present  study  should  test  its  distributions  for  normality.  No 
measure  of  kurtosis  of  the  distributions  is  given,  since  this  is 
obviously  that  of  the  normal  curve  in  every  case.  With  re- 
spect to  skewness  only  could  there  be  any  doubt  regarding  the 
normality  of  the  distribution.  The  measure  of  skewness  used 
is,  Sk  =  P.50  —  1/^   (P.90  +  P.io)  and  this  was  evaluated  in 

terms  of  its  standard  error,  (Tsu  =  .59914  — =  (Kelley,  25). 
A  significant  skewness  is  indicated  when  —  is  greater  than 

O-sk 

3.  Positive  skewness  as  obtained  by  this  formula  would  in- 
dicate a  piling  of  scores  at  the  upper  end  of  the  distribution, 
negative  skewness  a  piling  at  the  lower  end.  The  reliability 
coefficients  for  the  total  tests  were  computed  from  the  correla- 
tion of  halves  by  the  Spearman-Brown  formula. 

All  the  memory  tests  except  retained  members  and  syllable 
recognition  show  a  tendency  towards  negative  skewness,  in- 
dicating a  slight  piling  or  jamming  of  scores  at  the  lower  end 
of  the  distribution.  Such  a  jamming  would  indicate  that  the 
tests  are  slightly  too  difficult  for  the  group  of  subjects  used. 
However,  the  skewness,  when  evaluated  in  terms  of  its  stand- 
ard error,  appears  to  be  insignificant  in  all  cases  except  the 
word- word  test.  Even  in  this  case,  the  skevniess  is  just 
barely  significant,  and  not  very  marked.  This  skewness  would 
tend  to  lower  the  reliability  coefficient  of  the  test,  as  well  as 
its  correlations  with  other  tests.  Since  this  test  has  the  high- 
est reliability  coefficient  of  all  the  memory  tests,  the  effect  of 
the  skewness  is  probably  negligible.    The  tests  are  all  fairly 
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reliable,  considering  their  short  duration,  except  the  form- 
recognition  test.  This  test,  because  of  its  low  reliability 
coefficient,  has  been  dropped  from  the  final  evaluation  of  re- 
sults (cf.  pg.  40). 

A  few  comments  should  be  added  regarding  the  non-memory 
tests  used.  All  the  subjects  whose  records  were  retained, 
completed  the  vocabulary  test  within  the  time  allowed,  thus 
showing  it  to  be  primarily  a  power  test,  as  was  desired.  This 
was  not  strictly  true,  however,  of  the  arithmetic  reasoning 
test.  The  papers  were  examined  with  a  view  to  discovering 
for  what  per  cent  of  the  subjects  the  test  had  been  a  speed 
test.  In  order  to  exclude  somewhat  the  papers  on  which  items 
might  have  been  omitted  simply  because  they  were  too  difficult 
to  attempt,  an  incomplete  paper  was  defined  as  one  on  which 
two  or  more  items  were  omitted  at  the  end,  or  on  which  an 
entire  section  was  omitted,  to  which  presumably  the  subject 
had  intended  to  return  at  the  end,  but  was  prevented  by  lack 
of  time.  When  so  defined,  the  number  of  incomplete  papers 
was  116  out  of  a  total  of  298,  or  39%.  The  number  of  papers 
with  no  omissions  at  all  was  120,  or  40%,  60%  having  at 
least  one  omission.  In  so  far  as  the  arithmetic  reasoning 
test  was  a  speed  test,  its  reliability  coefficient  computed  by 
the  method  of  odds  and  evens  is  too  high.  In  the  case  of  a 
pure  speed  test,  such  a  method  of  computing  the  reliability 
coefficient  obviously  could  not  be  used  at  all,  since  the  reliabil- 
ity coefficient  would  then  be  practically  1.00,  through  purely 
spurious  influences.  The  Minnesota  paper  form  board  test 
proved  to  be  even  more  markedly  a  speed  test  for  this  group. ^ 
There  were  no  papers  without  omissions.  The  average  num- 
ber of  omissions  was  31.7956  and  the  average  number  of 
errors  11.0133.  The  correlation  of  errors  and  omissions  was 
— .1580  ±  .0438,  showing  that  the  two  are  probably  not  re- 
lated in  any  significant  way;  the  faster  person  on  this  test 
does  not  tend  to  be  either  more  or  less  proficient  than  the 
slower.  Considering  Form  A  and  Form  B  separately,  there 
is  a  fairly  consistent  tendency  for  errors  to  increase  and  omis- 
sions to  decrease  on  the  second  form. 

Average  No.  Average  No. 

of  Errors  of  Omissions 

Form  A  4.7822  18.9600 

Form  B  6.2811  12.8356 

'  It  will  be  recalled  that  the  reliability  coefficient  for  this  test  was  not 
computed  by  correlating  odds  and  evens  but  by  correlating  alternate 
forms.     (Cf.  page  34,  Chapter  III.) 
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The  subject  seems  to  increase  his  speed  at  the  expense  of 
accuracy,  probably  because  he  realizes  how  little  he  accom- 
plished on  Form  A  during  the  time  allowed.  Because  of  this 
situation,  the  results  obtained  with  the  two  forms  are  not 
strictly  comparable,  when  Form  B  is  given  immediately  after 
Form  A. 

II.  Intercorrelations  of  the  Variables 

In  Table  V  are  presented  all  the  intercorrelations  of  twelve 
variables,  including  eight  memory  tests,  three  non-memory 
tests,  and  age.  The  last  variable  was  included  in  order  to  hold 
age  constant  by  the  partial  correlation  technique.-  The  ob- 
tained correlations  with  age  are  all  very  low  negative.  Nega- 
tive correlations  with  age  would  have  been  expected  through- 
out, in  accordance  with  the  general  finding  that  the  younger 
students  in  a  class  are  usually  the  brighter.  The  obtained 
correlations  with  age  in  the  present  study  are  practically  zero, 
being  well  within  4  P.E.^  A  tentative  explanation  of  this 
result  may  be  offered  on  the  basis  of  the  negative  skewness  of 
the  age  distribution  (cf.  Table  II — pg.  27).  Since  the  other 
distributions  are  quite  normal,  the  skewness  of  the  age  dis- 
tribution would  tend  to  lower  the  correlations  of  age  with  the 
other  variables. 

All  the  correlation  coefficients,  including  those  with  age, 
have  been  corrected  for  attenuation.  Both  corrected  and  un- 
corrected correlations  are  given  in  Table  V.  The  uncor- 
rected coefficients  are  above  the  diagonal  extending  fromi  the 
upper  left  to  the  lower  right  hand  corner;  the  corrected 
coefficients  are  below  this  diagonal.  The  corrections  for 
attenuation  range  from  .0007  to  .2465,  averaging  .0684.  In 
view  of  the  fact  that  these  corrections  are  so  large,  it  was 
considered  advisable  to  use  both  raw  and  corrected  coefficients 
in  further  computations. 

The  correlations  with  age  partialed  out  are  given  in  Table 
VI.  Since  all  the  correlations  with  age  are  of  like  sign,  all 
being  negative,  partialing  out  age  usually  has  the  effect  of 


'This  was  simply  an  additional  precaution  in  securing  homogeneity; 
the  group  was  already  fairly  homogeneous  with  respect  to  age,  as  is 
shown  in  Table  II,  pg.  27. 

'  The  correlations  with  age  obtained  by  Schneck  (34)  on  a  similar 
grroup  were  larger. 
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lowering  the  coefficients/  unless  the  original  correlation  is 
negative;  in  this  case  the  resulting  partial  correlation  is 
still  higher  negative.  The  age  correction  is  in  most  cases  very- 
slight,  ranging  from  .0011  to  .0454,  and  averaging  .0103. 

In  order  to  give  a  general  idea  as  to  the  significance  of  the 
correlations  obtained,  the  probable  errors"'  of  the  highest  and 
lowest  correlation  coefficients  in  Table  VI  were  computed. 
These  P.E.'s  are  .0450  for  the  lowest  coefficient  (.0021,  be- 
tween vocabulary  and  picture-number)  and  .0189  for  the 
highest  (.7619,  between  color-word  and  retained  members). 
Furthermore,  with  an  N  of  225,  a  correlation  coefl[icient  must 
be  approximately  .17  or  higher  in  order  to  be  significant,  i.e., 
greater  than  4  P.E.r. 

The  average  intercorrelation  of  the  eight  memory  tests  is 
.2948  using  raw  coefficients,  and  .3995  using  corrected  coeffi- 
cients. The  digit  span  test  gives  the  lowest  correlations  with 
the  other  memory  tests,  its  average  correlation  with  the  other 
memory  tests  being  .1070  with  raw  coefficients,  and  .1425 
with  corrected  coeflficients.  On  the  basis  of  this  result  it 
seems  probable  that  digit  span  is  not  primarily  a  test  of 
memory  for  an  adult  group  of  subjects,  performance  on  it 
probably  depending  on  incidental  factors,  such  as  attention, 
an  active  attitude,  desire  to  do  well  on  the  test,  etc.  The 
memory  ability  required  for  a  successful  performance  on  this 
test  is  probably  so  slight  as  to  fall  well  below  the  general 
level  of  the  group.  In  a  group  such  as  that  used  in  the  present 
study,  therefore,  individual  differences  in  digit  span  are  prob- 
ably due  to  factors  other  than  memory  ability.  If  we  eliminate 
digit  span  for  these  reasons,  and  form  recognition  because  of 
its  low  reliability  coefficient,  the  average  intercorrelation  of 
the  remaining  six  memory  tests  is  .3912  for  raw  coefficients 


■*  One  exception  to  this  was  the  correlation  between  form-number  and 
color- word,  which  was  raised  from  -|-.6204  to  -f-.6258,  when  age  was  par- 
tialed  out.  This  is  due  to  the  fact  that  the  correlation  of  form-number 
with  age  is  nearly  0  ( — .0576)  and  that  of  color- word  with  age  fairly 
high  ( — .2386).    This  produces  the  following  situation: 

(0)       (high) 

ri;  —  ri3  r;3 j.^^  —  0 

y/l  —  r^3  \/l  —  r"23  low  decimal  ^" 

(1.00)  (low) 

^PEr=  .6745   (1  — r) 
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and  .5156  for  corrected  coefficients.  This  result  gives  fairly- 
good  indication  of  the  presence  of  a  common  factor  through 
the  memory  tests,  and  makes  the  application  of  further  tech- 
niques to  establish  the  presence  of  this  factor  and  its  approxi- 
mate importance  in  the  various  memory  tests  seem  fruitful. 
These  further  computations  are  given  in  section  III  of  the 
present  chapter. 

The  correlations  found  between  the  memory  tests  and  the 
three  non-memory  tests  offer  equally  suggestive  evidence  for 
the  independence  of  the  memory  factor.  The  average  correla- 
tion with  the  memory  tests  are  as  follows : 


Raw 

Corrected 

Vocabulary 

.0534 

.0576 

Arithmetic 

.1325 

.1473 

Minnesota 

.1240 

.1446 

All  these  average  correlations  are  less  than  4  P.E.r,  although 
some  of  the  individual  correlations  are  significant.  Some  of 
these  individual  correlations  bring  out  rather  interesting 
relationships  and  will  be  discussed  separately.  The  highest 
correlation  of  vocabulary  is  .2105  ±  .0430  with  syllable  recog- 
nition. The  fact  that  the  vocabulary  test  is  a  multiple  choice 
test,  depending  on  recognition  of  the  correct  synonym,  may 
throw  some  light  on  this  relationship.  The  next  highest  corre- 
lation of  vocabulary  (.1463  ±  .0440)  is  with  word-word,  as 
might  be  expected  because  of  similarity  in  content.  The  high- 
est correlation  of  the  arithmetic  reasoning  test  is  .2542  ± 
.0421  with  digit  span,  which  is  easily  attributable  to  overlap- 
ping of  content;  this  is  also  the  highest  correlation  of  digit 
span  with  any  other  test.  The  highest  correlations  of  the 
Minnesota  test  with  the  memory  tests  are  .3969  ±  .0379  with 
form  recognition  and  .2498  ±  .0422  with  form-number.  These 
results  are  also  what  would  have  been  expected  on  the  basis 
of  content.  The  correlation  of  —  .0154  ±  .0450  between  vo- 
cabulary and  arithmetic  reasoning  is  considerably  lower  than 
that  of  .2521  obtained  by  Schneck  (34).  The  correlation  of 
.3089  ±  .0407  between  arithmetic  reasoning  and  Minnesota  is 
interesting,  but  its  interpretation  is  outside  the  scope  of  the 
present  study. 

With  the  above  suggestive  evidence  on  the  presence  and  in- 
dependence of  a  memory  factor,  a  systematic  analysis  of  the 
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data  with  a  view  to  establishing  these  results  on  a  more  solid 
basis  will  be  undertaken  in  the  following  sections. 

III.  Preliminary  Survey  by  Means  of  the  Tetrad  Criterion 

Eliminating  the  form  recognition  and  digit  span  tests  for 
the  reasons  stated  above,  all  the  possible  tetrads  with  the  re- 
maining six  memory  tests  were  computed.  Table  VII  gives 
the  tetrad  differences  for  each  set  of  four  variables,  computed 
from  raw  coefficients,  and  below  each,  the  value  of  the  corre- 
sponding tetrad  difference  computed  from  corrected  coeffi- 
cients. The  tetrads  for  each  set  of  variables  have  been  ar- 
ranged in  the  three  columns  of  the  table  in  the  order  of 
(1)  ti234,  (2)  ti243,  (3)  ti342.  Several  of  the  tetrad  differ- 
ences are  significantly  greater  than  zero.  On  further  analysis, 
it  was  found  that  this  was  due  to  the  fact  that  some  of  the 
tests  were  too  similar,  producing  small  minor  group  factors. 
Thereupon  a  systematic  analysis  of  the  tetrad  differences  was 
made  in  the  attempt  to  locate  these  group  factors  and  deter- 
mine which  tests  should  be  combined  in  further  treatment  of 
the  data.  This  analysis  is  presented  in  column  V  of  Table 
VII.  Tetrad  differences  may,  for  convenience,  be  classified 
according  to  three  general  types.  (1)  All  three  tetrads  equal 
to  zero  (within  P.E.t),  indicating  a  general  and  specific  fac- 
tors, with  no  group  factors;  (2)  two  tetrads  equal  to  each 
other  and  the  third  equal  to  zero,  indicating  in  addition  to 
general  and  specific  factors,  group  factors  through  either  or 
both  of  two  pairs  of  variables  ;•''  the  particular  pairs  of  vari- 
ables containing  the  group  factors  can  be  definitely  determined 
by  seeing  which  two  of  the  three  tetrads  are  equal  to  each 
other,  according  to  Kelley ;  these  pairs  of  variables  have  been 
indicated  in  column  V  (Table  VII)  whenever  the  tetrads  are 
of  this  type.  (3)  None  of  the  tetrads  equal  to  zero  or  to  each 
other;  in  this  case,  it  is  impossible  definitely  to  locate  the 
group  factor  or  factors  or  even  to  assume  a  general  factor; 
the  entries  in  column  V  for  these  tetrads  indicate  simply  all 
the  pairs  of  variables  which  might  possibly  contain  group 
factors,  on  the  basis  merely  of  the  greater  magnitude  of  one 
of  the  two  products  in  any  one  of  the  three  tetrad  equations. 
Nothing  conclusive  is  claimed  for  this  analysis,  especially  re- 
garding the  entries  for  tetrads  of  the  third  type.     The  final 


Cf.  Kelley  (26)— proposition  No.  16,  pg.  69  ff. 
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test  of  the  validity  of  the  analysis  lies  in  the  success  with 
which  the  group  factors  are  eliminated  by  the  combinations  of 
those  tests  which  presumably  contain  group  factors.  The 
tetrads  computed  with  these  combined  tests  should  equal  zero, 
if  our  analysis  of  group  factors  has  been  successful. 


TABLE  VII. 

Tetrad  Differences  of  Six  Variables*  With  Raw  and  Corrected 

Coefficients. 


Variables 

t^ 

tvMI 

tl342 

Probable 
Group  Factors 

1234 

+  .0710 
+.1219 

.0216 
—.0330 

.0926 
—.1549 

12  or  34;  14  or  23 

1235 

+  .0414 
+.0657 

—.0861 
.1292 

—.1267 
.1949 

15  or  23 

1245 

+.1070 
+.1849 

+  .0807 
+  .1410 

—.0263 
—.0439 

12  or  45 

1236 

+.1043 
+  .1680 

+  .0519 
+  .0850 

.0524 
—.0834 

12  or  36 

1246 

+.0445 
+  .0734 

+  .0466 
+.0772 

+  .0021 
+  .0038 

None 

1256 

+  .0504 
+.0834 

+.0681 
+  .1116 

+.0177 
+  .0282 

12  or  56 

1345 

+.0518 
+.0881 

.0032 
.0095 

.0550 
.0976 

15  or  34;  13  or  45 

1346 

.0559 
—.1097 

+  .0013 
—.00401 

+  .0572 
+  .1057 

None 

1356 

.0608 
—.1061 

+.0347 
+.0565 

+  .0955 
+  .1626 

15  or  36 

1456 

+.0010 
+  .0077 

+  .0047 
+  .0091 

+.0037 
+  .00141 

None 

2345 

+  .1510 
+  .2731 

+  .1319 
+  .2380 

.0191 
—.0351 

23  or  45 

2346 

+  .0132 
+.0173 

+  .0581 
+.1015 

+.0449 
+  .0842 

None 

2356 

+  .0390 
+.0655 

+  .0928 
+.1591 

+.0538 
+  .0936 

23  or  56 

2456 

+  .0176 
+.0372 

+.0014 
+  .0028 

.0162 
—.0344 

None 

3456 

+  .0362 
+  .0767 

—.0623 
—.1265 

.0985 
—.2032 

36  or  45 

*  The  variables  are  numbered  as  follows : 

1.  Word-word  3.  Form-number 

2.  Picture-number  4.  Color-word 
t  See  discussion  on  page  45. 


5.  Retained-members 

6.  Syllable-Recognition 
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It  will  be  readily  seen  from  an  examination  of  Table  VII 
that  tetrad  differences  computed  with  corrected  coefficients 
are  always  larger  than  the  corresponding  tetrad  differences 
computed  with  raw  coefficients.  There  are  only  two  apparent 
exceptions  to  this  in  Table  VII,  namely  t,;u;4  and  U',r,4-  These 
apparent  discrepancies  are  due  to  the  fact  that  the  correlations 
used  in  computing  the  second  set  of  tetrads  in  Table  VII  are 
not  only  corrected  for  attenuation,  but  are  also  partial  correla- 
tions with  age  constant.  In  most  cases,  the  effect  of  partialing 
out  age  was  insignificant.  However,  when  the  tetrad  differ- 
ences are  themselves  very  small,  of  the  order  of  .01  or  .001 
as  in  the  case  of  ti3G4  and  ti564,  the  age  correction  stands  out 
and  reverses  the  effect  resulting  from  the  correction  for  at- 
tenuation. The  two  sets  of  tetrads  in  question  give  perfectly 
consistent  results  when  only  the  correction  for  attenuation  is 
applied,  without  partialing  out  age.  The  values  of  the  tetrad 
differences  then  become : 

ti346  =  —  .1021  ti456  =  +  .0019 

ti364  =  +  .0024  ti465  =  +  .0089 

ti463  =  +  .1045  ti564  =  +  .0070 

By  referring  to  Table  VII,  it  will  be  seen  that  in  each  case 
the  tetrad  difference  with  corrected  coefficients  is  larger  and 
of  the  same  sign  as  the  corresponding  tetrad  difference  with 
raw  coefficients."^ 

The  Probable  Error  formula  used  in  evaluating  the  obtained 
tetrad  differences  is  that  reported  by  Kelley  (26). »    The  P.E. 


'That  this  result  must  always  follow,  unless  the  tetrad  difference  is 
exactly  equal  to  zero,  can  be  readily  demonstrated  as  follows: 
Let  ti234  =  a  tetrad  difference  with  raw  coefficients,  and 

t'i234  =  the  corresponding  tetrad  difference  with  corrected  coefficients, 
then, 

ti234  ^  ri2  r34  —  Tis  r24 
Correcting  each  r  for  attenuation,  we  get, 

A.,     ri2  r34  ri3  tu 

I  1234  ^=^^      .      1       =     •       y 

•\/rii  r2ii       >yr3in  r^iv  vrn  ram        "v/^*"  ^"^ 

ri2     T3i  ri3     r24  tl2S4 

■\yrii   Tan    ram   r4iv  \/rii   1*211    ram    T41V 

Since  the  denominator  will  always  be  <  1,  t'au  will  always  be  >  ti2»4. 

«x,^  ^r,.r     /■;^rr'"  +  r'"  +  r'24  +  r'34  +  2r,2  r,4  r^.  r34  +  2r,3  r„  rj,  r24 

*P.E.ti234  =  .6745\/N  L 

—  2ri2  ri3  rja  —  2ra2  ri4  r^  —  2ru  ri*  ra4  —  2r28  r^  r34  4-  t'1234  (r'u  +  r\3  +  ^^«  + 


r'2,  +  r'24  +  r^34  — 4)1' 
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of  the  largest  tetrad  difference  in  Table  VII  (t32r.4)  is  .0240 
using  raw  coefficients  and  .0242  using  corrected  coefficients. 
The  P.E.  of  the  smallest  tetrad  difference  (ti4r,o)  is  .0214  for 
raw  coefficients  and  .0192  for  corrected  coefficients.  With  a 
given  N,  the  P.E.  differs  only  slightly  for  different  tetrad  dif- 
ferences. Several  P.E.'s  computed  for  tetrad  differences  in 
Table  VII  were  all  of  the  order  of  .02.  Since  the  evaluation 
of  the  tetrads  in  Table  VII  serves  only  as  a  preliminary  sur- 
vey for  the  location  of  overlapping  tests,  it  was  deemed  un- 
necessary to  compute  the  individual  P.E.'s  for  each  tetrad 
difference.  It  is  sufficient  in  this  preliminary  survey  to  know 
that  the  P.E.'s  are  approximately  .02. 

It  is  interesting  to  compare  the  effect  of  the  correction  for 
attenuation  on  the  tetrad  differences  and  on  their  respective 
P.E.'s.  Whereas  the  use  of  corrected  coefficients  consistently 
and  markedly  raises  the  numerical  value  of  the  tetrad  differ- 
ence above  zero,  it  scarcely  affects  the  final  value  of  P.E.t  at 
all.  As  a  result,  when  evaluating  the  tetrad  difference  in 
terms  of  its  P.E.,  the  chances  that  the  difference  appears  sig- 
nificantly greater  than  zero  are  greater  when  using  corrected 
than  when  using  uncorrected  coefficients.  When  the  correc- 
tion is  large,  amounting  to  as  much  as  .10  it  might  seriously 
distort  the  results.  In  view  of  the  fact  that  corrected  coeffi- 
cients represent  hypothetical  results  which  might  have  been 
obtained  under  ideal  conditions,  it  seems  safer  to  work  with 
the  coefficients  actually  obtained,  especially  when  the  correc- 
tions for  attenuation  are  large.  The  use  of  corrected  or  uncor- 
rected coefficients  does  not  in  any  way  alter  the  relative  mag- 
nitude of  the  tetrad  differences,  but  only  raises  their  absolute 
magnitude.  For  these  reasons,  in  computing  the  final  set  of 
tetrads  with  combined  tests,  raw  coefficients  have  been  used. 
The  computations  have  also  been  repeated  with  corrected 
coefficients;  the  results  obtained  thereby  are  reported  merely 
as  a  check  on  the  results  obtained  with  raw  coefficients. 

IV.  Evidence  for  a  Common  Memory  Factor 

The  tests  finally  selected  for  combination,  as  indicating 
group  factors  most  consistently,  are  2  and  3  (picture-number 
and  form-number)  and  4  and  5  (color- word  and  retained 
members).  The  following  set  of  variables  has  been  used  in 
the  computation  of  the  final  tetrads : 


A  GROUP  FACTOR  IN  IMMEDIATE  MEMORY  47 

1.  word-word 

2.  picture-number  and  form-number 

3.  color-word  and  retained  members 

4.  syllable  recognition 

The  correlation  of  the  individual  tests  were  taken  from 
Table  VI.  The  correlations  of  1  and  2,  1  and  3,  2  and  4,  3  and 
4,  were  computed  by  the  multiple  correlation  technique.  The 
correlation  between  2  and  3  was  computed  by  Spearman's 
formula  for  the  correlation  of  the  sums  of  two  series,  equally 
weighted  and  with  different  standard  deviations."  The  corre- 
lation coefficients,  tetrad  differences,  and  corresponding  prob- 
able errors  of  the  tetrad  differences,  are  given  in  Table  VIII. 

TABLE  VIII 
Tetrad  Differences  with  Combined  Tests^" 

ri2  =  .5245  ro3  =  .4876 

ri3  =  .5352  r24  =  .3867 

ri4  =  .2593  r34  =  .3439 

ti234  =  — .0266±.0288  =  —.9236  P.E. 
ti243  =  +.0540±.0208  =  2.5962  P.E. 
ti342  =  +. 0808 rt. 0220  =    3.6636  P.E. 

The  presence  of  a  central  factor  through  the  tests  of  imme- 
diate memory  seems  to  be  indicated  by  the  tetrad  analysis 
presented  in  Table  VIII.  Each  of  the  final  tetrad  differences 
is  less  than  four  times  its  probable  error  and  is  hence  statis- 
tically not  significant.  One  of  the  tetrad  differences  (ti342), 
is,  to  be  sure,  just  barely  within  the  limits  of  four  times  P.E.t. 
This  seems  to  suggest  that  some  group  factors  still  remain. 
However,  in  view  of  the  fact  that  the  three  tetrad  differences, 
taken  as  a  whole,  do  not  indicate  the  presence  of  consistent 
or  systematic  group  factors,  and  that  such  factors,  if  present, 
must  be  very  small,  as  indicated  by  the  size  of  the  specific 


'Spearman    (37) 

2  (<Ta  ffb  rah) 
r<ai  _)_  a2)  Cu   _(_    b2)    : 


•\/[2(<r'a)     +    22<ra    ffa  rna]       [SCA)    -I-   2l,cr^(Tb    Tbb] 

*'The  results  obtained  with  corrected  coefficients  are  here  presented 
as  a  check: 

r,2  =  .5929  r23  =  .66C3  t,2M  =  —.0691 

ri3  =  .6386  Tu  =  .5332  t,!43=  +.0542 

ri4  =  .3289  r34  =  .4554  ti3«  =  -}-.1233 
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correlations  (c/.  further,  Table  IX),  the  size  of  the  one  tetrad 
difference  in  question  cannot  be  regarded  as  undermining  our 
main  conclusion  regarding  the  constitution  of  the  four  vari- 
ables. 

V.  Correlations  with  Central  and  Specific  Factors 

The  correlations  of  each  of  the  four  tests  in  the  final  team 
presented  in  the  preceding  section  with  what  is  common  to  the 
whole  team,  were  computed  by  Spearman's  formula^^  for  the 
correlation  of  a  test  with  g.^- 


=V' 


—   ^  /  -^ab    ■'■ac 
ag  — 


Tbc 

Since  there  are  four  tests  in  the  battery  and  only  three  at  a 
time  are  used  in  computing  rag,  three  values  of  rag  will  be  ob- 
tained for  each  test.  These  values  have  been  averaged  in  ob- 
taining the  final  rag  values  presented  in  Table  IX.  Knowing 
the  intercorrelations  of  the  tests  and  the  correlation  of  each 
with  the  central  factor,  it  was  then  possible  to  compute  the 
correlations  between  the  specific  factors  in  each  test,  i.e.,  the 
intercorrelations  of  the  tests  with  the  central  factor  partialed 
out.  The  ordinary  partial  correlation  technique  was  used  in 
computing  these  coefficients.  The  values  of  these  partial  cor- 
relations are  also  given  in  Table  IX.  In  computing  the  probable 
errors  of  these  partial  correlation  coefficients,  the  ordinary 
formula  for  P.E.r  has  been  used,  this  formula  giving  the 
probable  error  of  a  coefficient  of  any  order,  total  or  partial. ^^ 

TABLE  IX 
Correlations  with  Central  and  Specific  Factors 


Correlations  vsdth 
Central  Factor 

Intercorrelations  with  Central  Factor 
Partialed  Out 

rig  =  .6623 
rag  =  .7720 
rag  =  .7355 
r4g  =  .4560 

ri2g=      .0277 
±.0450 

ri3  g  =      .0948 
±.0446 

ri4  6  =  — .0640 
±.0448 

r23g  =  — .1863 
±.0434 

r24g=      .0613 
±.0448 

r34.g  =      .0141 
±.0450 

"  Spearman  (39),  pg.  xvi,  Appendix. 

"  The   term    g    is    used    here    to   mean   any    general    factor    running 
through  four  tests,  and  is  not  g  in  Spearman's  sense. 
"C/.  Yule  (52)  and  (53,  pg.  352). 
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The  correlations  with  the  central  factor  are  all  sufficiently 
high  to  substantiate  our  conclusion  regarding  the  existence 
of  a  central  factor  through  all  the  tests.  The  correlations  be- 
tween the  specific  factors  in  all  the  tests  indicate  that  group 
factors  have  been  successfully  eliminated  by  the  combinations 
used.  The  only  one  of  the  six  partial  correlations  which  might 
be  considered  at  all  significant  is  the  negative  correlation 
r23.g.  This  correlation  seems  to  indicate  that  some  of  the  "spe- 
cific" factors  in  2  and  3  are  opposed.  Even  this  correlation, 
however,  is  just  barely  significant  when  evaluated  in  terms  of 
its  probable  error;  hence  it  is  very  doubtful  that  it  indicates 
a  true  relationship. 

VI.  Independence  of  the  Memory  Factor 

It  hardly  seems  necessary  to  take  further  steps  to  prove 
the  independence  of  the  memory  factor  from  the  factors  in- 
volved in  the  three  non-memory  tests,  considering  that  the 
average  correlations  obtained  with  these  three  tests  were 
practically  zero.  Nevertheless,  tetrads  have  been  computed 
with  the  three  "best"  single  memory  tests  and  each  of  the 
three  non-memory  tests.  These  tetrad  differences,  as  well  as 
the  Tag  of  each  of  the  non-memory  tests  are  given  in  Table  X. 

TABLE  X 

Tetrad  Differences  and  Correlations  With  the  Central 
Factor  in  the  Case  of  the  Non-Memory  Tests 


1. 

2. 
3. 

word-word 
picture-number 
retained  members 

4.  vocabulary 

5.  arithmetic  reasoning 

6.  Minnesota  Paper  Form-Board 

tl234 
tl243 
tl342 

=  +.0239 
=  —.0205 
—      .0444 

ti235  =  +.0027 
ti253=  +.0700 
ti352=  +.0673 

tl236  =  +.0308 
tl263  =  +.0513 
tl362  =  +.0205 

r4g 

reg 

=  .0615db.0448 
=  .1122±.0444 
=  .1000±.0446 

The  correlations  of  the  vocabulary,  arithmetic  reasoning, 
and  Minnesota  tests  with  what  is  common  to  each  of  these 
tests  and  the  three  memory  tests  are  all  low  and  insignificant, 
being  well  within  4  P.E.r.    These  results  definitely  establish 
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the  independence  of  the  central  memory  factor  found.  On 
examining  the  tetrad  differences,  however,  a  situation  which 
at  first  may  seem  puzzling  is  encountered,  since  the  tetrad 
criterion  is  satisfied  in  every  case.  This  brings  up  an  inter- 
esting theoretical  point  regarding  the  interpretation  of  the 
tetrad  criterion.  The  tetrad  difference  criterion  indicates  that : 
if  the  tetrad  differences  from  a  given  set  of  four  variables  are 
equal  to  zero  (within  P.E.t),  then  the  interrelationships  of 
these  four  variables  may  be  explained  on  the  basis  of  a  gen- 
eral and  specific  factors,  without  recourse  to  smaller  group 
factors.  However,  the  satisfaction  of  this  criterion  does  not 
tell  us  whether  or  not  the  "general"  factor  necessarily  runs 
through  all  four  variables;  it  simply  shows  that  we  need  as- 
sume no  more  than  one  common  factor  in  addition  to  the 
specifics.  This  necessary  restriction  in  the  interpretation  of 
the  tetrad  criterion  is  brought  out  very  nicely  in  the  fact  that 
the  criterion  will  be  satisfied  in  a  situation  in  which  there  is 
a  common  factor  running  through  three  tests,  but  not  through 
the  fourth.    This  can  be  demonstrated  very  readily : 

Let  1,  2  and  3  be  variables  made  up  of  a  central  factor  and 
specific  factors,  all  the  correlations  between  them  being  due 
entirely  to  the  central  factor.  Let  4  be  a  variable  having  no 
common  factors  with  any  of  the  variables  1,  2  or  3,  its  corre- 
lations with  these  variables  being  zero  (within  P.E.r). 

The  intercorrelations  will  then  be: 

in  which  m,  n,  and  p  are  any 
correlation  coefl!icients  greater 
than  zero. 

The  tetrads  will  be : 

ti234  =  ri2  r34  —  ri3  r24  =  m  X  0  —  n  X  0  =  0 
ti243  =  ri2  r34  —  ri4  r23  =  m  X  0  —  0  X  P  =  0 
ti342  =  ri3  r24  —  ri4  r23  =  n  X  0  —  0  X  P  =  0 

This  is  exactly  the  situation  we  have  when  we  combine  the 
three  memory  tests  with  one  of  our  non-memory  tests  in  the 
tetrads  reported  in  Table  X.  If,  however,  we  compute  rag  for 
variable  4  in  our  hypothetical  problem,  it  will  in  each  case  be 
zero,  indicating  the  absence  of  the  general  factor  in  this  vari- 
able: 


ri2  =  m 

1*23  =  P 

ri3  =  n 

ro4r=0 

ri4=:0 

r34  =  0 
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'     ri2  '     m 

^     ri3  \      n 

The  upshot  of  this  discussion  seems  to  be  that  the  ultimate 
criterion  of  the  presence  of  a  general  factor  through  a  given 
set  of  variables  is  not  the  tetrad  equation  but  the  correlation 
of  each  variable  vdth  the  central  factor ;  if  rag  for  any  of  the 
variables  is  less  than  four  times  its  P.E.,  then  we  cannot  as- 
sume the  presence  of  the  general  factor  in  this  variable,  even 
though  every  tetrad  difference  computed  with  it  may  be  zero.^^ 


VII.  Regression  Eqvxition  and  Multiple  Correlations  With 

Central  Factor 

The  multiple  regression  equation  for  estimating  the  central 
memory  factor  was  computed,  using  the  four  test  combina- 
tions finally  selected.    The  variables  in  the  equation  are : 

Xo  =  central  memory  factor 

Xi  =  word-word 

X2  =  picture-number  +  form-number 

X3  =  color-word  +  retained  members 

X4  =  syllable  recognition 

The  regression  equation  was  computed  in  terms  of  reduced 
scores,  each  score,  including  the  criterion  score,  being  ex- 
pressed as  a  deviation  from  the  mean  of  its  distribution 
divided  by  the  standard  deviation  of  that  distribution.  In 
this  form,  the  regression  equation  gives  the  relative  weights 
with  which  each  independent  variable  enters  into  the  de- 
pendent variable  (xo) .  The  values  obtained  for  the  regression 
coefficients  are  as  follows: 

Xo  =  .2020x1  +  .4433X2  -f  .3752x3  +  .1032x4 
The  multiple  correlations  of  successive  combinations  of  the 

"  The  tetrad  differences  should  be  computed  as  a  preliminary  step  in 
order  to  determine  whether  there  are  any  group  factors  through  the 
variables,  since  the  rag  formula  should  not  be  applied  when  such  factors 
are  present. 
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four  tests  with  Xo,  the  central  memory  factor,  were  also  com- 
puted.   These  correlations  are  as  follows : 

roi  =  .6623 

■"0(12)  — —  .0.^0  1 
■Ko(123i  -— -  -Ooo" 
Iv0(1234)   =  .8938 

The  last  multiple  correlation  (Ro(i234))  gives  the  correlation  of 
the  entire  battery  of  tests  (each  test  given  its  optimum 
weight)  with  the  central  memory  factor.  This  correlation, 
being  nearly  .90,  indicates  that  the  memory  factor  is  measured 
quite  completely  by  the  present  battery  of  tests. 

VIII.  Coefficients  of  Total  and  Net  Determination^^ 

The  coefficient  of  "total  determination"  gives  the  per  cent 
of  the  total  variance^®  of  the  dependent  variable  (xo)  which 
is  attributable  to  the  variance  of  all  the  independent  variables 
taken  together,  i.e.,  the  variance  of  the  entire  battery  of  tests. 
The  coefficient  of  total  determination  can  then  be  broken  down 
into  coefficients  of  "net  determination,"  showing  the  per  cent 
of  the  variance  of  the  dependent  variable  attributable  to  each 
of  the  independent  variables.  The  coefficients  of  total  and 
net  determination  have  been  computed  for  the  present  data 
from  the  regression  coefficients  given  above.    The  coefficient 

of  total  determination,  or  -^,  is  equal  to  R-odosi*,  being  simply 

the  square  of  the  multiple  correlation.  This  can  be  broken 
down  into  coefficients  of  net  determination  as  follows: 

R2                 boi.234    Poi         I        bo2.134    Po2         i        bo3.124    Po3 
0(1234)   —     o "T"      o ■" 


+ 


cTq  o^o  <^o 

bo4.123    P04 


o 
O-O 


in  which  boi.234,  bo2.i34,  etc.,  are  the  regression  coefficients,  and 
Poi,  P02,  etc.,  are  the  product  moments. 

The  above  formulas  have  been  taken  from  Watkins  (44). 
They  have  been  modified  for  use  in  the  present  study  as  fol- 
lows: 


"Watkins   (44). 

"  "Variance"  =  (S.D.)  = 
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Since,  poi  =    ^^,  and  r.n  =r  ^^,  we  may  write, 

•'■^  IN  <T()(Tl 

Pol  =  Toi    <T0    (Tl 

The  coefficients  of  net  determination  may  then  be  written  in 
the  form  of : 

Poi.234    Tqi     Q-q    q-i  boi.234    Toi     (Ti 

O^O  (To 

Since  we  are  dealing  with  reduced  scores  throughout,  all  the 
o-'s  are  equal  to  1.00  and  may  therefore  be  omitted  from  the 
formulas.     The  equation  in  its  final  form  then  becomes: 

•^'0(1234,   =  boi.234    1*01   +  bo2.134    1*02  +    bo3.124    I'OS   +   bo4.123    r04 

Substituting  the  appropriate  numerical  values  in  this  equa- 
tion, we  get : 

79.89%  xo  =  13.37%  Xi  +  34.22%  Xo  +  27.59%  X3  +  4.707o  X4. 

This  means  that  13.37%  of  the  total  variance  of  the  central 
memory  factor  is  attributable  to  test  1  (word-word),  34.22% 
to  test  2  (picture-number  +  form-number),  27.59%  to  test  3 
(color-word  +  retained  members),  and  4.70%  to  test  4  (syl- 
lable recognition),  the  total  battery  accounting  for  79.89%  of 
the  variance  of  the  central  factor. 

IX.  Size  of  the  Memory  Factor  in  Our  Tests 

Our  next  problem  was  to  find  the  degree  to  which  a  subject's 
capacity  in  the  central  memory  factor  determines  his  per- 
formance on  each  of  our  memory  tests.  It  can  be  shown  that 
the  per  cent  of  the  variance  in  a  test  due  to  the  central  fac- 
tor is  simply  the  square  of  the  correlation  of  that  test  with  the 
central  factor.  Let  Xi  represent  a  single  individual's  score 
in  test  1,  expressed  as  a  deviation  from  the  mean  of  the  dis- 
tribution. Let  X2  represent  the  same  individual's  score  in 
test  2,  similarly  expressed.    Then  we  may  write : 

[1.]     Xi  =  Cig  +  Si         (in  which  Ci  and  Co  are  constants, 
[2.]     X2  =  C2g  +  S2        g  the  central  factor,  and  Si  and  S2 

specific  factors). 

Multiplying  equations  1  and  2, 

X1X2  =  CiCog-  +  CogSi  +  CigSa  +  SiSo 

Summing  and  dividing  by  N, 

2x1X2  2g2     ,   ^  2gSi      ,    ^  SgSo     ,    SSiSo 

-IT"   =''''''  IT   -^""'-ir  +^^Tr  "^  "N" 
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Since  the  specific  factors  are  by  definition  uncorrelated  with 
each  other  and  with  g,  the  last  three  terms  of  the  equation 
drop  out,  being  equal  to  zero.    The  equation  then  becomes, 

ri20"i0'2  ^^^  CiC2cr~g 


[3.]  rio 


CTjcro 


Cio-R     __j  C20-g 


Let  ai  =    — -  and  a2  = 
We  may  then  write,  from  equation  3 


ri2 

— 

aiao 

ri3 

— 

aias 

ri4 

— 

aia4 

1*23  —  a2a3 
1*24  — —  Cl2<l4 
r34  =  0304 


Then  rag  =   J^'JlJ^  =    J 


aia2  aias 


r23  02C13 


=  ai 


Squaring  equation  [1]  above,  summing  and  dividing  by  N, 
we  get,  for  the  variance  of  test  1, 

^         c-i  o-2„  o-f 


.  •  .  1  ==  a^i  + 


o-„ 


SI 


.  • .  a^i  =  (rig)  2  =  variance  in  test  1  due  to  g. 

Applying  this  to  our  own  data,  we  find  that  the  variance  in 
each  of  our  four  memory  tests  due  to  the  central  memory  fac- 
tor is : 

Test  1  43.86% 

Test  2  59.60% 

Test  3  54.10% 

Test  4  20.79% 

Total  Battery  79.89% 

X.  Comparative  Evalvxition 

As  we  have  already  stated  in  Chapter  I,  the  present  prob- 
lem represents  only  one  phase  of  the  more  general  problem 
of  mental  trait  organization.    It  seems  fitting,  therefore,  now 
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that  our  own  specific  results  have  been  reported  and  inter- 
preted, to  present  these  results  in  their  broader  setting  and 
compare  them  with  the  results  obtained  on  other  group  factors 
by  similar  techniques.  The  results  obtained  by  Schneck  (34) 
are  comparable  to  our  results  both  with  respect  to  group  of 
subjects  used  and  with  respect  to  general  statistical  tech- 
niques. We  have,  therefore,  compared  our  results  on  the  mem- 
ory factor  with  Schneck's  results  on  the  verbal  and  number 
factors  with  respect  to  a  number  of  values.  In  Tables  XI, 
XII,  XIII,  and  XIV  are  presented,  for  each  of  the  three  fac- 
tors, correlations  of  tests  with  central  factors,  intercorrela- 
tions  of  tests  with  central  factor  partialed  out,  coefficients  of 
total  and  net  determination,  and  per  cent  of  variance  in  each 
test  due  to  the  central  factor.  Only  the  first  of  these  values, 
viz.,  correlation  of  tests  with  central  factor,  is  given  by 
Schneck  for  his  data ;  the  other  values  have  been  computed  by 
the  present  writer,  the  quantities  required  in  these  computa- 
tions being  available  in  Schneck  (34).  The  variables  taken 
from  Schneck  are : 

Verbal  Ability  Number  AbiliUj 

1 — ^Vocabulary  1 — Arithmetic  Reasoning 

2 Analogies  2 — Number  Series  Completion 

3 — Sentence  Completion  3 — Equation  Relations 

4 — Disarranged  Sentences  4 — Multiplication 

Our  results  on  the  memory  factor  are  very  similar  to 
Schneck's  results  on  the  verbal  and  number  factors.  The  cor- 
relation of  our  total  memory  battery  with  the  central  memory 
factor  is  slightly  lower  than  the  corresponding  correlation  of 
Schneck's  verbal  battery,  but  higher  than  the  correlation  of 
his  number  battery.  The  correlations  of  our  individual  mem- 
ory tests  with  the  central  factor  are  higher  than  his  correla- 
tions with  the  number  factor,  and,  although  our  two  best 
tests  of  memory  do  not  correlate  as  highly  with  their  central 
factor  as  his  two  best  verbal  tests,  our  two  poorest  memory 
tests  correlate  higher  than  the  two  poorest  verbal  tests.  In 
other  words,  our  memory  tests  are  more  uniform  in  the  de- 
gree to  which  they  measure  the  central  factor  than  are 
Schneck's  verbal  tests. 

The  intercorrelations  of  the  tests  with  the  central  factor 
partialed  out  are  fairly  uniform  in  the  three  factors  in  ques- 
tion, none  of  them  being  very  significantly  greater  than  zero. 
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TABLE  XI 
Correlation  of  Each  Test  With  Central  Factor 


Test 

Memory 

Verbal 

Number 

1. 

.6623 

.8695 

.7666 

2. 

.7720 

.8160 

.5593 

3. 

.7355 

.6081 

.4613 

4. 

.4560 

.3841 

.4867 

Total  Battery 

.8938 

.9306 

.8294 

TABLE  XII 

Intercorrelations  of  Tests  with  Central  Factor 

Partialed  Out 


Correlations     Memory 


Verbal 


Number 


ri2.g 

.0277   ± 

.0450 

.1706  -+- 

.0452 

.0430  ± 

.0465 

ri3r 

.0948  ± 

.0446 

.0256  + 

.0465 

.0383  ± 

.0465 

ri4.g 

.0640  + 

.0448 

.0362  -^ 

.0465 

—.0005  ± 

.0465 

I'23.g 

.1863  -^ 

.0434 

.1015  -*- 

.0461 

.0084  -f- 

.0465 

r24.g 

.0613  ± 

.0448 

.0519  -^ 

.0464 

.0498  ± 

.0464 

I'34.g 

.0141  ± 

.0450 

.0323  ± 

.0465 

.0590  ± 

.0464 

TABLE  XIII 

Coefficients  of  Total  and  Net  Determination 


Coefficient 

Memory 

Verbal 

Number 

Total 

79.89 

86.60 

68.79 

Net  1. 

13.37 

51.87 

28.15 

Net  2. 

34.22 

23.76 

15.98 

Net  3. 

27.59 

8.15 

9.74 

Net  4. 

4.70 

2.78 

8.56 

TABLE  XIV 

Per  Cent  of  Variance  in  Each  Test  Due  to 
Central  Factor 


Test 

Memory 

Verbal 

Number 

1. 

43.86 

80.37 

58.77 

2. 

59.60 

66.59 

31.28 

3. 

54.10 

36.98 

21.28 

4. 

20.79 

14.75 

23.69 

Total  Battery 

79.89 

86.60 

68.79 

I 
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The  coefficients  of  total  and  net  determination,  as  well  as  the 
variance  in  each  test  due  to  the  central  factor  substantiate  the 
conclusions  stated  above,  viz.,  that  (1)  the  memory  battery 
is  a  somewhat  better  measure  of  its  central  factor  than  the 
number  battery,  and  somewhat  poorer  than  the  verbal  bat- 
tery; (2)  the  individual  memory  tests  cover  a  larger  propor- 
tion of  their  central  factor  than  the  individual  number  tests ; 
and  (3)  the  individual  memory  tests  are  more  uniform  in  the 
amount  of  central  factor  they  cover  than  the  individual  verbal 
tests. 
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CHAPTER  V 

Summary 

1.  A  group  of  225  subjects,  chosen  because  of  their  homo- 
geneity with  respect  to  age,  racial  descent,  educational  and 
social  status,  etc.,  were  given  8  tests  of  immediate  memory  for 
visually  presented  material  and  3  non-memory  tests. 

2.  Evidence  of  the  presence  of  a  central  factor  through  the 
memory  tests  was  found  in  (1)  the  size  of  the  average  inter- 
correlation  of  the  memory  tests;  (2)  the  results  of  the  appli- 
cation of  the  tetrad  criterion;  and  (3)  the  correlations  of  each 
test  with  the  central  factor.  The  last  criterion  (rag)  is  shown 
to  be  the  most  crucial  on  theoretical  grounds. 

3.  The  independence  of  the  central  factor  in  our  memory 
tests  was  shown  by  the  correlations  of  the  non-memory  tests 
with  the  central  memory  factor,  all  of  which  were  smaller  than 
4  P.E.,. 

4.  A  multiple  regression  equation  for  estimating  scores 
in  the  central  memory  factor  from  our  battery  of  memory 
tests  is  given. 

5.  Coefficients  of  total  and  net  determination  showing  the 
per  cent  of  the  variance  of  our  central  memory  factor  attribu- 
table to  the  entire  battery  and  to  each  of  our  tests,  are  given. 
The  per  cent  of  the  variance  of  each  of  our  tests  due  to  the 
central  memory  factor  is  also  given. 

6.  A  comparison  of  our  data  with  those  of  Schneck  (34)  on 
the  verbal  and  number  factors  shows  considerable  uniformity 
in  the  results  of  the  two  studies. 
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